An under-ice hyperspectral and RGB imaging system to capture fine-scale biophysical properties of sea ice

Sea-ice biophysical properties are characterized by high spatio-temporal variability ranging from the meso- to the millimeter scale. Ice coring is a common yet coarse point sampling technique that struggles to capture such variability in a non-invasive manner. This hinders quantification and understanding of ice algae biomass patchiness and its complex interaction with some of its sea ice physical drivers. In response to these limitations, a novel under-ice sled system was designed to capture proxies of biomass together with 3D models of bottom topography of land-fast sea-ice. This system couples a pushbroom hyperspectral imaging (HI) sensor with a standard digital RGB camera and was trialed at Cape Evans, Antarctica. HI aims to quantify per-pixel chlorophyll-a content and other ice algae biological properties at the ice-water interface based on light transmitted through the ice. RGB imagery processed with digital photogrammetry aims to capture under-ice structure and topography. Results from a 20 m transect capturing a 0.61 m wide swath at sub-mm spatial resolution are presented. We outline the technical and logistical approach taken and provide recommendations for future deployments and developments of similar systems. A preliminary transect subsample was processed using both established and novel under-ice bio-optical indices (e.g., normalized difference indexes and the area normalized by the maximal band depth) and explorative analyses (e.g., principal component analyses) to establish proxies of algal biomass. This first deployment of HI and digital photogrammetry under-ice provides a proof-of-concept of a novel methodology capable of delivering non-invasive and highly resolved estimates of ice algal biomass in-situ, together with some of its environmental drivers. Nonetheless, various challenges and limitations remain before our method can be adopted across a range of sea-ice conditions. Our work concludes with suggested solutions to these challenges and proposes further method and system developments for future research

Multivariate texture-based segmentation of remotely sensed imagery for extraction of objects and their uncertainty

In this study, a segmentation procedure is proposed, based on grey-level and multivariate texture to extract spatial objects from an image scene. Object uncertainty was quantified to identify transitions zones of objects with indeterminate boundaries. The Local Binary Pattern (LBP) operator, modelling texture, was integrated into a hierarchical splitting segmentation to identify homogeneous texture regions in an image. We proposed a multivariate extension of the standard univariate LBP operator to describe colour texture. The paper is illustrated with two case studies. The first considers an image with a composite of texture regions. The two LBP operators provided good segmentation results on both grey-scale and colour textures, depicted by accuracy values of 96% and 98%, respectively. The second case study involved segmentation of coastal land cover objects from a multi-spectral Compact Airborne Spectral Imager (CASI) image, of a coastal area in the UK. Segmentation based on the univariate LBP measure provided unsatisfactory segmentation results from a single CASI band (70% accuracy). A multivariate LBP-based segmentation of three CASI bands improved segmentation results considerably (77% accuracy). Uncertainty values for object building blocks provided valuable information for identification of object transition zones. We conclude that the (multivariate) LBP texture model in combination with a hierarchical splitting segmentation framework is suitable for identifying objects and for quantifying their uncertainty

Mapping water content in drying Antarctic moss communities using UAS-borne SWIR imaging spectroscopy

Antarctic moss beds are sensitive to climatic conditions, and both their survival and community composition are particularly influenced by the availability of liquid water over summer. As Antarctic regions increasingly face climate pressures (e.g., changing hydrology and heat waves), advancing capabilities to efficiently and non-destructively monitor water content in moss communities becomes a key research priority. Because of the complexity induced by multiple micro-climatic drivers and its fragility, tracking the evolution and responses of moss bed moisture requires monitoring methods that are non-intrusive, efficient, and spatially significant, such as the use of unoccupied aerial systems (UAS). In this study, we combine a multi-species drying laboratory experiment with short-wave infrared (SWIR) spectroscopy analyses to first develop a Random Forest regression Model (RFM) capable of predicting Antarctic moss turf water content (~5% error). The RFM was then applied to UAS-borne SWIR imaging data (900–1700 nm, resolution) of the moss beds at high spatial resolution (2 cm) across three sites in the vicinity of Casey Station, Antarctica. The sites differed in terrain, snow cover, and moisture availability to evaluate method capabilities under different conditions. Optimum RFM parameters and input variables (spectral indices and reflectance spectra) were determined. Maps of moss moisture were validated via acquiring moss spectra and water content (using sponges inserted into the moss turf) collected in situ, for which an exponential correlation (R2 = 0.72) was reported. RFM further allowed investigation of the influential spectral variables to model water content in moss and associated spectral water absorption features. We demonstrated that UAS-borne SWIR imaging is a promising new tool to map and quantify water content in Antarctic moss beds. Hyperspectral mapping facilitates the exploration of the spatial variability of moss health and enables the creation of a baseline against which changes in these moss communities can be measured

Portable Device for Continuous Sensing with Rapidly Pulsed LEDs – Part 1: Rapid On-the-fly Processing of Large Data Streams using an Open Source Microcontroller with Field Programmable Gate Array

We designed a portable system using an open source microcontroller (μC) with built-in field programmable gate array (FPGA) for on-the-fly data acquisition and processing of optical data generated from rapidly pulsed infrared light emitting diodes (IR LEDs) for optical sensing of gases. The system is used for rapid pulse generation (ca. 2 μs short pulses with a typical repetition rate of 1 kHz) to drive the IR LED, as well as for the optical sensing data acquisition and processing on-thefly large data streams of ca. 2 Gbit/s. The flexibility and performance of the system is demonstrated. Each of the digitally processed signal pulses yielded one data point of analytical signal in time as a quasi-continuous data stream produced at a rate of between 1000 and 0.1 Hz. This microcontroller-based portable open source platform is then implemented in on-the-fly data acquisition and processing, of analytical signals enabling continuous gas sensing

Underwater Hyperspectral Imaging (UHI): a review of systems and applications for proximal seafloor ecosystem studies

Marine ecosystem monitoring requires observations of its attributes at different spatial and temporal scales that traditional sampling methods (e.g., RGB imaging, sediment cores) struggle to efficiently provide. Proximal optical sensing methods can fill this observational gap by providing observations of, and tracking changes in, the functional features of marine ecosystems non-invasively. Underwater hyperspectral imaging (UHI) employed in proximity to the seafloor has shown a further potential to monitor pigmentation in benthic and sympagic phototrophic organisms at small spatial scales (mm–cm) and for the identification of minerals and taxa through their finely resolved spectral signatures. Despite the increasing number of studies applying UHI, a review of its applications, capabilities, and challenges for seafloor ecosystem research is overdue. In this review, we first detail how the limited band availability inherent to standard underwater cameras has led to a data analysis “bottleneck” in seafloor ecosystem research, in part due to the widespread implementation of underwater imaging platforms (e.g., remotely operated vehicles, time-lapse stations, towed cameras) that can acquire large image datasets. We discuss how hyperspectral technology brings unique opportunities to address the known limitations of RGB cameras for surveying marine environments. The review concludes by comparing how different studies harness the capacities of hyperspectral imaging, the types of methods required to validate observations, and the current challenges for accurate and replicable UHI research